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AfiSTlACT 



Itaai response changing as a function of test anxiety 
*was investigated* Se\renty graduate students enfolled in a basic 
statistifis course completed 7 3 aultiple-choice items on course . 
content and the Test AMiety Scale (IAS) . The TAS consisted of 25 
itess that students indicated ifer% descriptive (true* or not 
descriptive (falsa) of t^aaselves. Students were ciassxfiai as high* 
aoderata* or lOK-anxieus baaed on their iAS scores. Changed answers 
on the aultifle-choice iteas were identified by inspection of the 
tests as neli as aarksensa sheets and vere classified ^ cDrrect 
changes (wrong^tQ-right) * incorrect changes (right*to-tfrong) * and 
-TWfctal changes (tfrong-to^wrong) * students were unaware or the nat^re 
of the research project whenHaking ithe tests. Dat^ supported the 
hypothesis that high test anxious students aaka more itea response 
changaa than low test anxious students. Results also suggested that 
Isoth high and low anxious students profit to a siailar extant 
propprtionally froa answer changing* It was further found that jnore 
responses ware changed on difficult than on easy iteas for both high ^ 
aftd low anxious students* Test anxiety is suggested as a factor 
'forming te^t*taking style* (Author/SL) , / ' , v ' 



leptoductions supplied by lOES are, the -best that caa be made * 
0'. froiD the original ddcuient. * 



erJc 



EDUCATION 4 WiL FARE 
NAriONAL INSTITMTE OP 

EDUCAtiON ^ 

-. [>.M. HI IN Wtr»lrf*j. 



ITEM RESPONSE CHANGES ON MULTIPLE-CHOICE TESTS 
" AS A FUNCTCON OF TEST ANXIETY* ' 



'Katliy 'Grdun 
University of Washington 



■ PERNilSSION TO RiPRODUGE THjS 
MATiRlAL VlAS iilN GRANTED BY 



TO^THi EDUCATION AL RESOURCiS 
INFORMATION CENTER (IRICj " 



^ 'Prasfenfced at the American Educational Research Association 

/ annual* convent ion J Los ^Angelas, 1981* ^* 

* . » 



ERIC 



The author wishes to ^hank Daniel Rock and especially Dr. Glll^'ert Sax for t'leir 
comencs on an earlier draft of this paper ^ ^ ^ 



' Abstract 

/ ■ ^ 

Item response changinp as a function of test anxiety was investigated. 
Seventy p,raduate students completed tte Test Anxiety Scale ^ 
73 multiples-choice items durinp the, quarter. ' The data supported the ^ 
hypothasis that high test anxious students make more Item respnnse chanp;es 
Chan low test anxious .students. Results -also suggested that both high an^ 
low anxious students profit. to a similar extent proportionally from ^answer 
cHanping. It was further found that more rajponses were changed on 
difficuirC than on^efsy items for both high and low anxioufr students. 
Test anxietv is suggested as a factor formlnf, test-staking style. 




i ) 



Many studies^have shown the advantage of chapging anawers on objective 
examinations (e.g*,-2) and that a stable misconception exists among students 
regarding the hazards of answer-charging (e*g. , 8).'"* Howaver, littlt? data ar^, 
available concerning the relationship between item response changes and. personality 
characterlstins. Mueller and Shwedel^CA) suggested that "personality variables 
such as impulsivity ^r anxiety, may correlate with the incidence arid 'effectiveness ^ 
of ariswer-changlng behavior". McHorris /and Leonard (3). examined the relationship 
□ fv several personality variables, Ihcludlng J.mpuisivity and anxiety, to item 
response changes, and fpund contradictory ^relationships with item r^sronse-ahanging 
across four groups of subjects. In one group, for e^s^mplei those who profited 
from changes were low anKious while in another group those profiting from chanpas 
Here high anxious. However, the number of subjects in ^ch gr^u^ was ^mall 
(ranging from 17 to 50) i and the measure of anxiety used was a generalized index 
rather than a test-specif i« anxiety scale. The present study Employed a larger ^ ^ 
sample as well as a test^spec if ic measure of anxiety. It was hypothesized^ that 
students with higher scores on the Test Anxiety Scale (TAS)C6) would^ change more 
item Responses than low anxluis students but that the ratio of correct to total, 
number of changes would be lower for high than for low anxious students. The 
primary concern of t>iis* study was whether in administering achievement tests, _ ; 

teachers shoufd advise all students, regardless of test-anxiety level, to 
change responses if they feel their initial answer might incorrect. Based on 
pa&t research, counselors and tethers who attempt to provide advice ^or pretest 
practice in test4>taking may wish to encourage their students to chanie answers. 
However, past research has not , specif ically addresirted possible .differences In 
benefits from answer-changing for sfu^#nt^ of different »anxiety levels. It wal 
unglcar,^ then, 'whether teachl^s' advice should uniform for all stud^ents or wriether 



'teachers shpuld tailor *thair recommendations hased on perceptions af their studd^ts' 

* ' ' ^ . 

personalitis.^. » , * ' ' - ^ ^ ' 

' * * * ■ - *■ 

Numerous studies suggest that achiavement is negatively correlated with 

test anxiety. Several scudlas have investigated the relationship between total' 

test score and points gained by changing answera and h^v found higher scoring 

students tending to gain mora from respanse changes that lower scoring students, 

(■e/g.,.4). Thesa'>eported r alat ionships may, be spuriously high bacAUse gained points 

/ * . * i 

havH been^added into Cotal "test score. Smith et al. (7) eliminated this problem 

by calculating' pre- and pbst-changa' scores , the former reflecting the score that 
would have been achieved had no answer been, changed and the lattar ^ref leoting scores* 
a£ter accounting for changers in answers. If high anxiou^ sCudentsWereiva lower 
scores, the relationship between'"per f-ormance and rate of i^m .reaponae change 
confounds the relationship between ^nxlety and rate of item response change. The, ^ 
present study employed pre- and post-change scores as, control variables in examining 
the relafionshtp, brtween anxi|^y' and ■gains that are due to changing answers. 

Another aispect of item response . changes examlnedsin this sq^dy was the relation- 
ship between nutfibet of responses changed it em difficulcy, aod test anxiety. Beck (1) 
fouiid that although difficult items elicited more, response changes, point gains 
occured- more f.rSquently with items of low or moderate difficu,lty tlfen with high 
difficulty items. Mueller and Waaser (5) point out .that the relationship is confounded 
since changed 'answers, alter item difficulties. To eliminate this problem, both 
pi-i- and post-change Item di *'lculties were comp'::ted. 
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, Parcicipants in this study were 70 graduate students'^ enrdlled in a basic 
statistics course at the UnlverBlty'of Washington during the winter quarter of 
1980. The.TAS was adralnistered during class time. 'The TAS consists of 25 
Items chht students Indicate are either descriptive- of "themselves itrue) or 




(false). It is. a ^test-specific measure of anxiety -and is described in further 
detail ii/sarason ( 6 )- Although comp] ec Ion. of the form was voluntary, 
approx€ma€'aly 90% of- the class ccjmpleted the TAS within tHe 15 minuCes- ailowed . 
Scudents were classified ps high- (12-20) , inofi era te- (7-11) , or low-anxious (0-6)' 
baaed on thelv TAS scores. • 

i Students completed three se^rate\ultiple-choice tests during the quarter^ 

on the course content presented in lectures and, the text. A to£al-of 7 3 items 
were available for analysia. For each tes^, students recorded their ansWerson 
warksense sheets. _ Students- were encouraged ^lao to record their answers on thp 
test -Itself which was to be returned later. Changed answers were identified by ^ 

^^nspectlon.oVthe tests '^s well as the mafksense sheets and were class^ified as^ 
correct changes (wrong-to-right) . incorrect changes Crlght-to-wr^ng) , and heutra'r 
changes (wrong-to-vrtong) . Student., were unaware of the nature >of the res'earch ^ 
project wh'en taking the tegCs. j ^ 

'RESnLTS 

Table 1 'presents the means and standard deviations for total number of Item 
response changes, number of correct, incorrect, and neutraa^ changes -and for the 
ratio of correct to total number of changes by anxt%^ gr&p. 'A one-way analysis 
of variance of total nuinber of chariges (Table 2) yielded a sign^icant (p<.05) 
main effecl^or anxiety WuP- "hen total test score (calculated both for pje- \ 
and post-change) was used as a covariate, the main effect of anxiety grodp was, 
again slgntficant at p<.05, , # ■ . 

' (Tables 1 and 2 about here) 



The ratios of correct to total changes were not significantly differenc 
among anxiety groups. Also, no significant dif f ere.ces" wera fousd- among groups 
m Che number of correct item changes. " This result was changed when total 

test score was used as a covariata. 

Items were categorled as difficult (p=0.0-.39), moderate (p=.40-.69), or 
easyCp-. 70-1.0) both before and after icpm response changes had been counted. 
A one-way analysis of variance on both ^ber of correct changes and total number 
of changes yielded a ' sigriif leant main effect for Item d-lfflculty group C-Tables 3 
and 4) . This resulfr was the same whether pre-change or ^ost-change Item ' 

(Tables ^ and 4' about hpre) 
difficulty was used to classify test items. Table 5 presents the means and 
standard deviations for number cor:rect and total number ^f changefe by pre- and 
post-Chan^ item difficulty group. The numbers of item responses changed was ^ 

(Table 5 about here) ' * ■ 

significantly greater for the high anKious group than for the low anxious group 
for easy (t 2.05, p<.05) and moderately difficult iteins (t^2,74j p<.05); the 
difference for. difficult Ttems was not significant, * Both high and low anxious 
groups' gained significantly mora points from response changes on difficult items 
than on easy^itent^ when items were classified by pTe-change difficulties, When 
post-change difficulties were used to classify items, the difference Ici points 
gained between difflcul't and easy items was' no longer signlf icaat , However, the 
ratio of corr^ict.to total number of changes was significantly lower foy 
difficult than for eas^ Items whan either pre- or post-change score was used to^ 

classify items (Table 6) * ^ 

" (Table 6 about here) 



^ DISCUSSION; 

The data support the hypothesis that high test nnxious atuden'ts -make more 
item response changes than low test anxious students. This relationship was 
upheld when the confounding effect of performance (total test scornl was remuved. 
Evidence was not found chat the ratio of correct to total number of changes 
differed significantly for high and low test-anxious students. These results 
suggest that both high and low ahxious sCudenta profit to a similar extent 
prpportlonally from answer-changing, chough the net effect is a reduced score 
for high anxious students. These results partially support those found by 
McMorris and Leofiard (3) and are. consistent with the posicion expressed by 
Mueller and Shwedel (4). Based on these studies and the present one, teachers 
should recommend to both high and low test-anxious students that answers should 
be changed If it is felc that the initial response was incorrect. 

The finding that more responses were changed on dlf f icult ^han on easy 
Items supports Beck's (1) results. Difficult Items elicited |he most changes 
with the least success for hof^ high ind low, anxious studentp. Low anxious 
students changed fewer response^- to ea^sy and moderately dlfflculC items than did 

f 

high anxious students. 

yhe method of detecting changes used in this study xs imprecise^ erasures 
mav have indicated clerical errors rather than reconsiderations and all erasures 
may not have been detected. However, generalizability^across comnon tpsting 
conditions was considered to be of greater importance than 'some degree of 
imprecision in the dependent measure. - ^ 

The results of this study suggest that test anxlsty level is one of the 
factors forming a "personality style of test taking". Further research Is . 
required to Investigate other personality variables relevant to item response 
changes. The .Item reaponse-changlng behavior of high, anxious subjects miy reflect 



dealing with a subsec of the information available^ in an item rather than t^i^^^ 
total Information. Upon a second reading » the subset pf. cues at tended to may 
changa and thus the integration df l^formation-to-answer might change. 
Specification and contrast of the differences between the cognitive pnocesses o 
high and low anxious studenCs who are uncercain of an item rGspunse would clear 
ba of interest. 
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Means and Standard Deviations on the Anxiety Scale and Itrm RespoASG^ Changes 

by Anxiety Group 



Anxiety Group ^ 

Anx i e t V Low Moderate High Tocal 

Mean 3.90 8-42 14.94 9.04 

SD 1.5 1,4 ^ 2.2 5.0 

Correct Changes 

Mean 3. 52 ' 3.86 4.88 4.09 

SD 2.2 1.9 * ^ 2.5 2.3 

I nc o r r e cc Chan g e s 

Mean 1.28 1.81 1.83 1.63 

SD 1.3 1.5 1.3 1.5 

^Neutral Changes 

"4* 

VMean . 1*. 04 1.10 ' 1.92 1.36 

h . 1.3 1.2 ' 1.4 1.3 

Total Changes 

■Mean . ' 5.84 6.76 8.63 7.07 

SD 3.1. . 3.1 4.0 3.7 

Ra t lo of Co r r e c t ; To t a 1 

Mean .58 .59 .56 .57 ' 

SD , .27 .17 , .22 .24 

Ns 25 21 24 70 
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Tabla 2 



Analysis of Varlaiice by Anxiety Group Using Number of Item Response' Changes as the 
, i ' Dependent Variable" - 







Source 


df 


MS 


F . 




* 

Anxiety Groups 


z' 


48. 92 


,3.85* ' 




jflrror 


67 


12.70 














i 


Total ■ 


69^ 


• 


* • 



■*p<.05 
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Table 3 



Analysis of Variance by p±f f icult^Group Using Number of Correct Responaa / 

Changes ks the dependent Variable , f. 



I y 



# ^ ^ ■■ 4 - - 


/ Source 


df , 


MS 






' " Difficulty Hrpup 
Error 
Total , 


2 
70 
72 " 


61.12 
3.94 


15.52* 
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- • ' , Table 4 \ ' . - 

^ ' ' , ' • « • 

Analysis of Variance .by Difficulty Group Using Total Number of , Item Response Changes 
• . as the Dependent Variable' 



*p<,01 



Source 


t _ — 

* df 


MS 


F 






Difficulty Group 
. Error 
Total 


2 

70 " 

72. 


310.98 
8.38 


37,12* 
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Table 5 



Means and Standardr Deviations of Correct Changes, Total Changes, and Ratio'' of 
Correct iTotai,, Chinges by Item Difficulty Group (Pre- and Post-Change) 



Pre-ChAge 



Item Difficulty Corre 
_ Group Mean 



■Difficult 5.00 
Moderate ^ 5*35 

Easy ^ 2.69^ 



Changes 
SD 


' Total 
Mean 


Changes 
SD 


Ratio 
Mean 


R Items 


2.4 


10^75 


• 3.8 


..465 


^ 12 . 




9.15 


3.1 


.589 


26 


1.7 


3.91, 


2.4 


.688 


35 



^ . " Post=Change 



Difficult 




4.50 


2.8 


11.25 


4.4 


.400 


8* 


Moderate 




5.45 


2.1 


9.41 


3.1 


^580 


22 


Easy 




3.21 




4.81 


3.1 


.670 


43 



. Y 



% Table 6 . * 

'a 

^alysia Df V^rianca^ of Ratio of Correct iTotal Changes by Item^ Difficulty ^Group 



Souretf ^ r% dt . MS 



Difficulty Group . 2 .S6W ^ 4.88* 

Error , _ 70 * .0745 

• Tocbl — 72 



*p<.05 



Difficulty Group 


Mean ^tio 
Correct iTotal' 


'SD 


t 

N itamS 


^■-^^ay 
Ho'derata^ 


. i ,733 1 
.586 


.37 


26 5 


, Difficult 


,469 


.18 


12 


Total 


.63^ 


.29 


73 



